Active recursive Bayesian inference using Rényi information measures
نویسندگان
چکیده
• An active recursive inference method based on Rényi information measures. Posterior probability changes can enhance both query optimization and stopping criterion in the RBI process. Using entropy α -divergence unifies multi-objective problem. The proposed unified framework enhances speed accuracy, presence of an adversarial prior. Recursive Bayesian (RBI) provides optimal latent variable estimates real-time settings with streaming noisy observations. Active attempts to effectively select queries that lead more informative observations reduce uncertainty until process is stopped at a certain confidence level. However, mismatch between querying objective creates conundrum improving performance one expense deteriorating other. Moreover, conventional methods stagger misleading prior information. Inspired by theoretic approaches, we propose where are jointly selected through formulation enables us accuracy We theoretically demonstrate encourages exploration Furthermore, motivate our proving geometrical representation for decision making simplex. provide empirical experimental studies two applications including restaurant recommendation brain-computer interface (BCI) typing systems outperforms comparable approaches accuracy.
منابع مشابه
Dynamic Bayesian Information Measures
This paper introduces measures of information for Bayesian analysis when the support of data distribution is truncated progressively. The focus is on the lifetime distributions where the support is truncated at the current age t>=0. Notions of uncertainty and information are presented and operationalized by Shannon entropy, Kullback-Leibler information, and mutual information. Dynamic updatings...
متن کاملWyner's Common Information under Rényi Divergence Measures
We study a generalized version of Wyner’s common information problem (also coined the distributed sources simulation problem). The original common information problem consists in understanding the minimum rate of the common input to independent processors to generate an approximation of a joint distribution when the distance measure used to quantify the discrepancy between the synthesized and t...
متن کاملRényi information measures for spectral change detection
Change detection within an audio stream is an important task in several domains, such as classification and segmentation of a sound or of a music piece, as well as indexing of broadcast news or surveillance applications. In this paper we propose two novel methods for spectral change detection without any assumption about the input sound: they are both based on the evaluation of information meas...
متن کاملRényi generalizations of quantum information measures
Quantum information measures such as the entropy and the mutual information find applications in physics, e.g., as correlation measures. Generalizing such measures based on the Rényi entropies is expected to enhance their scope in applications. We prescribe Rényi generalizations for any quantum information measure which consists of a linear combination of von Neumann entropies with coefficients...
متن کاملInformation importance of predictors: Concept, measures, Bayesian inference, and applications
The importance of predictors is characterized by the extent to which their use reduces uncertainty about predicting the response variable, namely their information importance. The uncertainty associated with a probability distribution is a concave function of the density such that its global maximum is a uniform distribution reflecting the most difficult prediction situation. Shannon entropy is...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Pattern Recognition Letters
سال: 2022
ISSN: ['1872-7344', '0167-8655']
DOI: https://doi.org/10.1016/j.patrec.2022.01.009